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FOREWORD 


The investigation described in this report was performed by the 
Electrical and Systems Engineering Department of Rensselaer' Polytechnic 
Institute for the Flight Dynamics and Control Division of the Langley 
Research Center as a part of the Digital Fly-By-Wire Program. It was 
carried out during the period September 15, 1972 - June 15, 1975- The 
investigation was headed by Professor Howard Kaufman who was assisted 
by three graduate students supported under the grant. 
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RESEARCH IN DIGITAL ADAPTIVE 
FLIGHT CONTROLLERS 

■by 

Howard Kaufman* 


SUMMARY 


Adaptive flight control systems are of interest because of their 
potential for providing uniform stability and handling qualities over a 
wide flight envelope despite uncertainties in the open loop characteristics 
of the aircraft. Since such controllers combine the functions of perform- 
ance assessment, state and parameter estimation, gain adjustment, and control 
computation, it is most advantageous to consider implementation in digital 
rather than analog fly-by-wire systems. 

To this effect, a study has been made in order to define an 
implementable digital adaptive control system which can be used for a typical 
fighter aircraft. Since online adjustment of the control gains requires an 
easily computable index of performance, a model of the desired aircraft behav- 
ior was developed and used in real time for computing the error between plant 
and model output. 

With regard to control gain adjustment , based upon the error in 
model following, consideration was primarily given to explicit adaptive con- 
trol systems which directly utilize parameter estimates for gain adjustments. 
Implicit adaptive controllers, while not requiring the explicit computation 
of parameter estimates , are not readily tunable to system specifications 
unless the plant and model structures are such that a "perfect model follow- 
ing" control law can be defined. 

Relative to the need for both parameter and state estimates, it was 
observed that online estimation of the states and parameters is best performed 
by a weighted least squares procedure which first identifies the parameters 
directly from the noisy measurements, and then computes state estimates using 
both the parameter estimates and the noisy measurements. 

Based upon analytical studies and simulation of both the linear and 
nonlinear aircraft equations of motion, two explicit adaptive controllers 
were recognized as being suitable for inflight implementation. The first 
design uses control and gain adaptation logic developed using infinite time 
linear optimal regulator theory. Control gains are therefore stabilizing 
(for a fixed system) and are adjusted in response to parameter changes through 
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an iterative correction made to the Riccati matrix. The second design is 
based upon single stage performance indices which result in gains that are 
immediately computable by formula evaluation. To assure stability of the 
closed-loop system, a simplified Riccati iteration was used for correcting 
the feedback gain matrix. 

Results showed that these adaptive controllers were effective in 
compensating for parameter variations and were even capable of rapid recovery 
from highly erroneous parameter estimates which could in fact define a set 
of destabilizing gains. 


1, INTRODUCTION 


1.1 Background 

Fly-by-wire flight control systems have been of considerable inter- 
est to designers because of their advantages over mechanical linkages in 
coping with the complex control problems associated with high performance 
aircraft and space vehicles. Furthermore, with the present capabilities 
for incorporating integrated circuits into lightweight low cost minicomputers 
and microcomputers, digital implementation of fly-by-wire control becomes 
especially attractive. Digital logic is itself very reliable and with ade- 
quate redundancy incorporated into the design, such a system can be designed 
to insure adequate flight safety.^ 

Another feature of digital implementation which makes it extremely 
advantageous is the potential for the implementation of complex control 
systems which incorporate high order nonlinearities and which utilize time 
sharing for multiple loop control. One such complex control structure is an 
adaptive system which is capable of online adjustment of the control para- 
meters in response to changing flight characteristics. The desirability for 
such adaptive control systems has been established for providing uniform 
stability and handling qualities over the complete flight envelope despite 
drastic changes in the aircraft’s open loop characteristics, even in the 
presence of disturbances. Although control parameters (e.g., gains) can 
be scheduled as a function of altitude and mach number, this is not always 
desirable because of the inaccuracies which arise from computing offline and 
then scheduling the aircraft characterizations at different flight conditions 
and the effects of unpredictable uncertainties themselves (e.g., sloshing, 
fuel- weight, structural changes). 

Thus , because of the attractiveness of adaptive control and the 
availability of digital flight computers, the possibility of implementing a 
digital adaptive flight control system has been studied since September 1972. 
Preliminary results of this study have led to two adaptive control algorithms, 
namely: 

. An interfacing of linear optimal regulator logic with a 
weighted least squares identifier. 

. An interfacing of control logic designed using a single 
stage performance index with a weighted least squares 
identifier. 

Although implementation of this latter structure was very simple 
relative to that of the former, stability could not be guaranteed even if 
identification were perfect; thus some modification was necessary. Another 
important result from this study was the recommendation that in view of 
observed convergence properties, parameter identification be performed separ- 
ately from state estimation. 
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Towards the. goal of developing digital adaptive flight control 
algorithms suitable for implementations in an onboard digital computer, con- 
tinued efforts have been concerned with stabilizing the single stage adap- 
tive control logic, determining identification requirements and evaluating 
the designed control systems on NASA Langley's nonlinear six degree of 
freedom simulation. 

It should be noted that since stability in the presence of large 
parameter variations was of concern, initial studies were concerned with 
explicit adaptive controllers which make direct use of online parameter 
identification.^’ ‘ Implicit adaptation procedures which do not require expli- 
cit parameter estimates for adjusting controller gains, do not guarantee 
stability unless certain idealistic structural constraints hold.®»9 However, 
because of the attractiveness of eliminating the need for identification 
logic, some effort has since been expended in defining a stable implicit 
adaptive controller useful for digital flight control. 

1.2 Objectives 

In view of the desirability for designing an implementable digital 
adaptive flight control system, Rensselaer Polytechnic Institute has since 
September 1972, performed research related to the following overall objec- 
tives: 

1) Develop and evaluate adaptive control logic using the 
linearized lateral and longitudinal equations of motion 
for a typical fighter aircraft. 

2) Evaluate the linearized designs on NASA Langley’s nonlinear 
six degree of freedom dimulation. 

3) Recommend digital adaptive control logic suitable for 
inflight implementation 

1.3 Scope and Outline 

Development of a digital adaptive flight control system requires 

the: 

. Development of mathematical models 

Formulation of the controller structure and the gain 
adjustment procedures 

. Design of parameter and state estimation logic 

As stated in the preceding sections, all initial designs were per- 
formed using the linearized lateral and longitudinal equation for a typical 
fighter aircraft. The precise modelling of these dynamics along with a 
description of the representations of the actuator dynamics, sensors, and 
bending modes is contained in Section 2.0. 
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Using these models, two distinct explicit adaptive controllers were 
designed based upon optimal linear regulator theory and a single stage index 
modified so as to insure stability. These are discussed in Section 3.1.1. 
Results of a parallel study on the feasibility of implicit adaptive con- 
trollers are presented in Section 3.1.2. 

In view of the need for parameter estimation for explicit adaptive 
control, an analytical and experimental study was made of cmdidate procediires 
for online identification. These results are contained in Section 3.2. 

Results of evaluating the overall adaptive control system on both 
the linearized and nonlinear equations of motion are presented in Section U, 
and finally, conclusions regarding implementation are presented in Section 5. 

1.4 Significance 

Development of a digital adaptive flight control system is of signif- 
icance not only to the particular aircraft considered but also to digital pro- 
cess control in general. Such a development represents an important applica- 
tion of modern digital control theory that is a step towards the narrowing of 
the gap between theory and practice. 

Of immediate significance was the demonstration of two digital 
adaptive control flight controllers which are capable of identifying and com- 
pensating for time varying uncertainties in the open loop characteristics 
without the need for altitude and mach number information. 

2. PROBLEM FORMULATION 


2.1 Mathematical Representations 

2.1.1 Aircraft Dynamics 

2. 1.1.1 Linear Representation 

The linearized dynamics of the aircraft as supplied by NASA can be 
represented by the vector state equation 


where x 

u 

“P 


X = F X + G u 
-P P -T P “T 

denotes the incremental state vector 

denotes the incremental control vector 


( 2 . 1 ) 


and 


F^ and are matrices of the appropriate dimension. 


In particular, for linearized lateral notion: 
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roll rate 
yav rate 
sideslip angle 
roll angle 


( 2 . 2 ) 


u = 


aileron deflection 
rudder deflection 


( 2 . 3 ) 


Similarly for linearized longitudinal motion: 


pitch rate 


velocity 
angle of attack 
pitch angle 


( 2 . 4 ) 


elevator deflection 
Thrust 


( 2 . 5 ) 


The elements of F and G known to vary with mach number and 
altitude were provided for a typical fighter aircraft for several flight con- 
ditions (FC's). These are provided in Appendix A. 

The objective of the research was to find implement able digital 
algorithms for computing the control signals 6^, 6^, 6 , and 6,^, so as to 
insure uniform and desirable handling quantities for an® aircraft "^flying with- 
in the given flight envelope. This was to be performed assming that during 
flight, the elements of F and G were not readily available (e.g., as 
scheduled functions of macS number Snd altitude). 

Because of the need to implement the control system in a digital 
flight computer, eq. 2.1 was transformed into the equivalent discrete form: 


X (k+1) = A X (k) + B u (k) 

-p p -p p -p 


( 2 . 6 ) 


where A = e 
P 


F T \ 

e ^ dT G 


T = Sampling period 
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and X (k), u (k) denote x , u at time k • T 

Eq. 2?6 is a"^alid representiitioi?assuming that F and G do not vary for 
k T £ t _< (k+l) T and that the control signal is constant "between sample 
times, i.e., 

u (t) = u (kT) for kT £t £ (k+l) T 


2.1.1. 2 Nonlinear Effects 

Since the controllers designed using the linearized equations of 
motion defined in 2. 1.1.1 were to "be applicable to the actual nonlinear six 
degree of freedom equations, it is necessary to recognize that the x and 
u vectors of eq. 2.6 are incremental variables which result from a~^linear- 
i?ation about the trim conditions. Thus if x ^ and x respectively 
denote the actual and trim aircraft state vectors , and u and u ^ 
respectively denote the actual and trim controls, then 


a 

X = x 

t 

- X 

(2.7a) 


-p 

II 

P 

t 

- u 

(2.7b) 

-P -P 

“P 

However, in 

actual flight. 

these trim states will not be explicitly 


available for computational purposes. Furthermore, direct computation of the 
trim states themselves is not permissible because of the lack of knowledge of 
the stability derivatives and the severe computational requirements needed 
for solving the resulting nonlinear system of equations. 

Thus as an alternative it is suggested that the trim states be 
computed by averaging or low pass filtering, the actual state vector. This 
is reasonable in view of the expectation that the pilot will almost always be 
flying the aircraft close to trim conditions. As an example if denotes 

a particular state of interest , 

X. = a X. + (1 - a) X. 

1 1 1 

where 0 < a < 1 

If straight and level flight is in progress, then a should be set close to 
1.0 resulting in a filter which will effectively smooth out any disturbance. 
However, if a maneuver is required as indicated by a significant change in 
the pilot input, then a should be set closer to zero in order for the filter 
to be able to track the change in trim. These adjustments in a could be 
made by the computer program in response to sensed stick motion. 

If, however, the trim states computed in this manner, are not 
acciarate, in that they do not satisfy the true nonlinear equations of motion, 
then a bias term must be added to eq. 2.6 so as to account for the additional 
errors. Thus controls would have to be computed for the system: 


7 



X (k+l) = A X (k) + B u (k) + C (2.8) 

“P P ”P P 

where elements in the vector should he identified along with the elements 

A and B . 

P P 


2.1,2 Actuator Dynamics 

In order to more effectively evaluate the developed control algor- 
ithms it is necessary to include the influence of the actuator dynamics in 
the equation of motion, 2.1. This effect can he modeled hy placing in series 
between each component of the control vector u and the aircraft dynamics, 
a set of secondary and primary actuator dynamics^ defined hy the equations: 


= -2 C 
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sec sec 
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sec 


sec 


6 + 0 ) 
e sec 

sec 


(2.9a) 


= -2 ? 


sec 
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sec sec 
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sec 


sec 


+ 03 


sec 
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(2.9h) 


= -2 ? 


sec 


0) 
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sec 
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+ 03 


sec 


(2.9c) 


for the aircraft considered, ? 


sec 


, 5 and 03 = 100. 

sec 
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= (5 


= (6 


= (6 


= (6n 


sec 


sec 


sec 


«^)/Ti 


° )r 

B." 2 


(2.10a) 

(2.10b) 

(2.10c) 

(2.10d) 


For the aircraft of interest, = 1/12.5, = 1/30, . x = 1/25, and Xj^ = 1/5. 

The computed control signals 6 ,6 ,6 are thus in reality applied to 

ear 
c c c 

the secondary actuator dynamics, eqs . 2.9; the outputs of which, 6 , 

sec 

6 , 6 are then in turn applied to the primary actuators, eqs. 2.10, 

a r 

sec s.ec 

to yield the aircraft input vector u . Note that the thrust input requires 
only the primary actuator dynamics d^ined by eq. 2.10d. 


These actuator equations can be used in a test simulation in order 
to determine the effects of neglecting them in the design of u , or they 
can actually be incorporated into eq. 2.1 and used for direct imputation of 
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the actuator xnputs (6 ,6 ,5 ,6_). 

e a r T 

sec sec sec c 

2.1.3 Sensor and Bending Modes 

In designing the adaptive control system, it was necessary to take 
into account the effects of sensor noise and structural bending modes. These 
were modelled as correlated noise sequences which were added to the state 
variables in order to form the measurements, y^. More precisely 

2^(k) = 3^(k) + n(k) (2.1l) 

where x as before denotes the aircraft state vector 
“P 

n^ represents the correlated measurement noise sequence 
Zp denotes the measurement vector. 

Characteristics of the measurement noise are given in Appendix 

2.1.4 Disturbances 


In evaluating the performance of the adaptive controller, it was 
necessary to take into account the response to wind disturbances and the 
requirements for a deterministic dither signal to aid identification. 


To evaluate the effects of wind, the longitudinal response to verti- 
cal disturbances was considered by simulating an angle of attack perturbation 
equal to the ratio of the wind velocity to the aircraft velocity. The power 
spectrijm of the wind velocity W(t) was defined by: 





( 2 . 12 ) 


where L = 762m (2500 ft.) 

a = standard deviation of the wind velocity in m/sec 
and = aircraft velocity 

Thus the angle of attack perturbation Aa can be written as: 


Aa = W/Vq 

and the modified longitudinal equations of motion become: 


(2.13) 


9 


dt 


(2.14) 


[A 

\ h ^ 



fv ’ 

1 V 


Ap(2.3) ' 
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II 
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\bI 

\e / 
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Wittt regard to computed or deterministic dither signals for aiding 
identification, it was necessary to take into account that the resulting 
behavior be imperceptible to the pilot. This fact was modelled by constrain- 
ing maximum lateral acceleration to be less than 0.03 g and maximum longitud- 
inal acceleration to be less than O.lg in response to commanded dither inputs. 

2 . 1.5 Desired Behavior 

Inherent to the effectiveness of any adaptive control system is the 
capability for rapidly assessing the performance and making the necessary 
modifications to the control gains. One such procedure that fits these 
requirements and at the same time has the potential for insiiring uniform 
handling qualities is the concept of model following control. This concept 
has been of interest to many investigators over the past few years. 

In fact, relative to these efforts, Erzberger^^ has published a set of condi- 
tions under which the output of the process can be made identical to the out- 
put of the model. 

Being that the ideal objective of model following flight control is 
to force the aircraft to respond as the model would to a given pilot command, 
it is often desirable to simulate the online model dynamics in the flight 
computer and to generate the aircraft control signal using the actual air- 
craft states, the pilot input commands, and the model states. This situation 
is sometimes referred to as the pilot’s flying of a computer with the computer 
flying the aircraft. 


More precisely the model following problem can be stated as follows: 


Given the aircraft dynamics: 


X (k+l) = A X (k) + B u (k) 
V P "P 


(2.15) 


where 


and 


X (k) is the aircraft (nxl) state vector at sample time k 
“P 

u (k) is the (mxl) control vector 
“T 

A , B are matrices with the appropriate dimensions ; 


find the contol u (k) such that the process state vector x (k) approxi- 
mates ”reasonably"^ell" some model’s state vector x (k) defined by the 
equation: 
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(2.16) 


X 

— m 


(k+l) = A X 
m -m 


(k) 


B u 
m — m 


(k) 


where x (k) is the (nxl) model state vector 
“m 

u (k) is the (mxl) pilot input 
“m 

and A , B are matrices of the appropriate dimensions, 

m m 

The desired behavior for the aircraft considered in this study was 
defined by the following continuous models specified by NASA. 
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(2.17) 




(2.18) 


eigenvalues = (O., -0.1, -l.l^jS.l) 

As shown in fig. 2.1a an aileron step command, while not affecting 
sideslip and yaw rate, results in an overdamped roll rate response with a 
settling time of about 0.5s. However, a rudder step does affect all states 
as shown in fig. 2.1b. With regard to the desired longitudinal response, 
figs. 2.2a and 2. 2b show that while a thrust command affects only the 
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velocity, an elevator command will affect all states except for the velocity. 

2.2 Adaptive Control System Representation 

When designing an algorithm to he implemented, practical considera- 
tions must have influence on the trade-off between accuracy and simplicity. 

In a digital adaptive flight controller, one of the prime practical restric- 
tions is the size and speed of the online digital computer. This will 
affect both the timing and storage requirements of the adaptive system shown 
in block diagram form in fig. 2.3. The smallest time interval is the control 
computation interval and typically is betweeh 0.03 and 0.20 seconds. 

State estimation if used must be as fast, since the state is used by the 
feedback controller in calculating the new control. 

The two larger intervals involve gain adaptation. The parameter 
identification interval must not be longer than the gain update interval, 
since the gain update algorithm requires the new parameter estimates. If 
parameter estimation alone is performed, then it is possible to have the 
identification interval greater than the control period; however, if states 
and parameters are to be estimated simultaneously, then it is necessary that 
these be equal. 

The various functions to be implemented are discussed below. 

2.2.1 Controller Formulation 

In designing an adaptive control system, it is necessary to first 
give consideration to the design of either an explicit or an implicit adap- 
tation algorithm; the differences being that: 

. In explicit adaptation, online estimates of the aircraft 
parameters are used for gain adjustment. 

. In implicit adaptation, some measure of the error between 
the actual and the desired state trajectories is used for 
gain adjustment. No explicit parameter identification is 
used. 

Previous studies have indicated the advantages of explicit adapta- 
tion if gain magnitudes are constrained and if large parameter variations 
are to be expected. Furthermore no implicit adaptive control system which 
has been developed to date can guarantee stability unless Erzberger ’ 
conditions for perfect model following hold.® >9 in view of these items, 
this study has concentrated on the analysis, synthesis, and subsequent evalu- 
ation of explicit adaptive controllers for inflight implementation. However, 
in parallel with these efforts, some consideration has been given to develop- 
ing implicit adaptive controller which do guarantee stability at least in the 
sense of a bounded error between the plant and model states. These results 
are discussed in Section 3.1.2. 
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FIG. 2.3 ADAPTIVE CONTROLLER STRUCTURE 
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In designing a model reference adaptive control system, it is 
necessary to develop a control algorithm that is meaningful in terms of per- 
formance and is readily adjustable online in response to parameter variations. 
To this effect quadratic performance indices which simultaneously weight the 
error , 
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X 

-m 


- X 

■-P 


(2.19) 


and the control vector u were minimized subject to the satisfaction of the 
state equations . 


If the model state vector is defined as in eq. 2.15» then the error 
vector can be written as : 


e(k+l) = 


X (k+l) 
—m 


X (k+l) = 

~P 
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X (k) 


+ B 
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U (k)) 

— m 
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X (k) 


+ B 


^(k)) 


( 2 . 20 )- 


This representation of the model dynamics as part of the state equation leads 

to a real model following control configuration which requires the model 

state vector x for implementation. 

~m 


Alternatively the model dynamics can be incorporated directed into 
the performance index by defining 


;(k+l) = (A 
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X (k) 


+ B 
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u (k)) - 
— m 


(A, 


X (k) 

~P 


+ B 


u (k) ) 
“P 


( 2 . 21 ) 


This definition which corresponds to re-initializing the model state at each 
step to the aircraft state results in an implicit model following controller 
which is independent of the model state 

Although real model following is more complex in that it is neces- 
sary to initialize the model states equal to those of the aircraft, it was 
anticipated and shown by experiment that it is more effective in compensating 
for unknown parameters and distiirbances . For actual implementation of such 
a system, it is suggested that the model state vector be reset equal to the 
aircraft state vector whenever a significant change in pilot command u is 
detected. Alternately, this initialization procedure might be perform^ 
sequentially with a period equal to twice the largest closed loop time 
constant - 


2.2.2 Gain Adaptation 

Since the controller parameters must be readily adjustable online 
in response to identified parameters variations, it would be ideal if the 
control gains were easily computable algebraic functions of the parameters in 
the aircraft equations of motion. 

This type of controller will in fact result if a single stage per- 
formance index of the form: 


l6 



( 2 . 22 ) 


J(k) = e^(k) Q e(k) + u *^(k) R u (k); Q, R > 0 

— — -p -p — 

is However, since this index results in a set of control gains 

which do not guarantee stability, it may be desirable to incorporate Chan’s 
modification^^ and include an error feedback term of the form Ke^, where 
K must be determined so as to stabilize the closed loop aircraft matrix 
(A - B K).^^ With this modification, the feedforward gains from the model 
caE stiSl be computed online as algebraic functions of A and B , but the 
gain K must either be computed in an iterative manner sB as to stabilize 
(a , B ) or must be determined a priori offline so as to (if possible) 
stEbil?ze (A , B ) over the entire flight envelope. 


An alternate procedure for computing the control gain is to use 
an infinite time quadratic performance index of the term 

oo 

J = I [e''^(k) Q e(k) + u^^^Ck) R u^Ck)] (2.23) 


when Q _> 0, R >_ 0. 

This approach is attractive in that it yields a constant set of feedback gains 
that stabilize the closed loop control system. However, since the gains 
require solution of a nonlinear matrix Riccati equation, an online iterative 
procedure must be used for adaptation pTirposes.17 


2.2.3 Estimation 


Because of the need for using both the state vector x and the 
aircraft matrices A , B for explicit adaptive control computation, it was 
necessary to include^est?mation logic into the system as shown in fig. 2.3. 

In designing estimation algorithms, attention must be given to the 
measurement noise characteristics. Whereas a relatively large variance neces- 
sitates the use of an identifier with a long memory to achieve smoothing, a 
small variance will enable the use of a short memory identifier that will be 
more responsive to parameter variations. 

Furthermore in a digital environment, it is advantageous to 
identify the unknown parameters of the discrete transition matrix itself 
rather than the physical stability derivatives. This follows because the dis- 
crete transition matrix is a highly nonlinear function of the stability deriv- 
atives making identification rather difficult. Since the discrete control law 
itself is directly related to the discrete transition matrix, the latter would 
ultimately have to be recomputed using the stability derivative estimates. 

Finally, of importance is the performance of the identification pro- 
cedures under closed loop control. Because such control often results in 
transient behavior for only a very small amount of time and steady state be- 
havior for a relatively large amount of time, there may not be sufficient 
excitation to allow accurate enough identification. Thus the need for an 
induced dither signal must be examined. Such dither could in fact be produced 
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by feeding back for control computation the noisy state measurements them- 
selves rather than filtered state estimates. In any event the performance of 
the identifier should ultimately be measured by the overall behavior of the 
adaptive control system rather than the individual estimates it produces for 
the various parameters. This follows from the fact that not all states are 
equally excited by any given pilot input command. Hence various motions will 
be completely decoupled or very insensitive to the specific values obtained 
for some of the parameters. Thus while there may not be sufficient excita- 
tion present to accurately track a parameter, its value may not be influential 
to the maneuver being undertaken. Accurate tracking of all parameters con- 
tinuously will only be possible if dither can be acceptably introduced into 
the motion of the aircraft - 

An additional factor which can aid the identification is the effect 
of having an improperly identified aircraft resulting in the application of 
erroneous control gains which in turn can cause erratic motion. However, 
since identification works best in the presence of such motion, it is antici- 
pated that the adaptive system will rapidly correct for large inaccuracies. 

3. PROBLEM SYNTHESIS 

3.1 Control Computation Procedures 

3.1.1 Explicit Adaptive Controllers 

Explicit adaptive control logic directly utilizes online parameter 
estimates for adjusting the control gains; thus, relative to implicit adapta- 
tion, better stability margins with lower gain requirements were anticipated. 
Two explicit adaptive control systems were subsequently designed and tested. 

3. 1.1.1 Adaptive Optimal Linear Regulator Logic 

Because ease of implementation was an important consideration, a 
linear feedback structure with constant gains (for a given flight condition) 
was very desirable. To design such a system, infinite time quadratic per- 
formance indices were minimized for the system defined by eqs. 2.15, 2.l6. 

Such an index generally consists of some positive semi-definite quadratic 
fimction of the model following error (x (k) - x (k)) balanced against a 
positive quadratic function of the contr^ i^(k')^ 

Alternatively it was shown by Asseo^^ that penalizing the control 
rate u (t) rather than the control itself yields reduced sensitivity to 
plant parameter variations. For the continuous case this necessitates treat- 
ing the plant control u (t) as an additional state variable with correspond- 
ing equation, 


u (t) = V (t) 
-V “T 


thus resulting in a type one controller. 


(3.1) 
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Relative to a type zero controller, a type one controller yields 
improved steady state performance, reduced sensitivity, and the capability 
for penalizing the control rate itself. Thus the discrete version of the 
type one controller was defined by replacing the integrator by an acciamulator 
(i.e., a unit delay with unity feedback). The corresponding state equation 
then becomes: 


u (k+l) = u (k) + V (k) 

-p' -p" -p' 


(3.2) 


The optimization problem used for defining the controller was: 


Minimize: 


J = ^ I {(3^(k) - 3^(k))^ Q(x^(k) - X„(k)) 


k=0 




+ V '^(k) R V (k) + u ^(k) S u (k)} 


subject to: 


X (k+l) = A X (k) + B u (k) 
P -P P -P 

u (k+l) = u (k) + V (k) 

-P ^ 

X (k+l) =A x(k)+B u(k) 
— m m -m m -m 

u (k+l) = u (k) 

— m — m 


(3.3a) 

(3.3b) 

(3.3c) 

(3.3d) 

(3.3e) 


This cost index (3.3a) represents the simultaneous penalization of 

model following error, control rate, and the control vector itself, each 

weighted according to the designer's choice of Q, R, and S. Note that an 

additional state equation (3.3e) is used to represent the pilot input 

u (k) as a step function. This results in a set of control gains independent 

^ the step magnitude which in turn can be accounted for by specifying it as 

an initial condition, u (O). 

~m 

With regard to model initialization, since it is desirable upon 
application of a pilot input u that the plant and model be at the same 
state, X (O) was set equal to x (O). Furthermore, to reflect the fact 
that control surfaces cannot chan^ instantaneously, u (O) was selected as 
zero. Finally, it was determined through simulation thSt weighting u in 
eq. (3.3a) was not necessary in view of the weighting on v . Thus ^ has 
been replaced by zero for the remainder of the development 


This optimization problem can now be cast into the form: 


Minimize : 


J 


oo 

i 'I [x^(k) Q’ x(k) + l(k) R' u(k)] 
k=0 


(3.4a) 
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subject to 


x(k+l) = A x(k) + B u(k). (3.^*b) 

where : 



The existence of a set of optimal control gains for this problem 
can be demonstrated even though the model, which has been incorporated into 
the state equations, is not controllable. ^9 The control u(k) = v (k) 
will be a linear feedback law of the form: 

u(k) = ~K x(k) (3.5) 

The control gain K is then in turn defined by the relation: 

K = P B + R)"^ B^ P A (3.6a) 

where P is specified by the steady state Riccati equation: 

P = Q + A^PA - a'^PBCR + b'^ PB)~^ b'^ PA (3.6b) 

By partitioning eq.. 3.5 the control can be expressed as: 

u (k+l) = u (k) + V (k) ( 3 . 7 ) 

“P ~P “P 

or 

u (k+l)= -K X (k) - K X (k) - K u (k)+(l-K )u (k) (3.8) 

— p X — p X — m u — m u 

^ P m m p 

Similar partitioning of P into: 
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Pll 

P12 

P13 

Pl4 

T 

P12 

P22 

P23 

P24 

P13'^ 

P23'^ 

P33 

V3h 

Pl4'^ 

P24’^ 

P34^ 

p44 


results in the following alternative form of eq,. 3.6b 

Pll = Q + Ap^(Pll - P12(P22 + R)“^ P12'^) (3.9a) 

P12 = A ^ [(P11-P12(P22+R)“^ P12'^)B +P12(I-(P22+R)"^ P22)] {3.9'b) 

p P 

P22 = B [(P11-P12(P22+R)"^ P12'^)B +P12(I-(P22+R)"^ P22)] 


. p 

+ [(I-(P22+R)“^P22) P12'^] B +P22(I-(P22+R)“^ P22) (3.9c) 

P 

P13 =-Q + A ^ (P13 - P12(P22 + R)”^ P23) A (3.9<i) 

p m 

Pl4 = A ^ [pi4+(P13-P12(Paa+R)"^P23)B -P12(P22+R)“^ P24] (3-9e) 

p m 

P24 = B [p14+(P13-P12(P22+R)“^P23)B -P12(P22+R)“^ P24] 

p m 

+ (P23-P22(P22+R)"^ P23)B + P24-P22(P22+R )”^ P24 (3.9f) 

m 

P23 = B ^(P13-P12(P22+R)"^ P23)A +(P23-P22(P22+R)“^P23)A (3.9g) 

p mm 


P33, P34, and P44 were not needed for defining the control gains and there- 
fore were excluded from computation. 


The specific gains defined by eq. 3.8 may now be expressed as: 


K = -(P22 + R)“^ (P12^ A ) 

"P 

K = -(P22 + R) ^ (P12^ B + P22) 

-p P 

^x = -(P22 + R)“^ P23 A 
m m 

K = -(P22 + R)“^ (P23 B + P24) 
u m 

m 


(3.10a) 

(3.10b) 

(3.10c) 

(3.10d) 
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Although the above expressions do appear quite formidable for 
online evaluation, iterative procedures do exist for solving the Riccati 
sub-equations (3-9 a, b, c, d, e, f, g). Once the P submatrices are avail- 
able, evaluation of the gains (eqs. 3*10) is straight forward formula eval- 
uation. The required inverse, which is common to all four gain matrices and 
thus need only be computed once, is of the same dimension as the control 
signal. For the aircraft problem being treated, this inversion is of second 
order, and thus can be perfonned by simple . formula evaluation. 

The adaptation logic for this type controller is based upon an 
online iteration of the partitioned Riccati equation, eqs. 3-9* Since the 
aircraft parameters vary continuously and relatively little within the 
anticipated gain update cycles, it can be expected that the exact solution 
to the corresponding steady state Riccati equation will not vary significantly 
between gain updates. Thus, if at each gain update time the Riccati equation 
is initialized with the most recent solution, it is hypothesized that it will 
be necessary to iterate only a few times to find the proper solution. 

Three iterative procedures, as described below, were considered for 
updating the solution to eq. 3.9. 

• Backwards iteration of the time varying Riccati solution 


This procedure, which is the simplest to implement, is equivalent 
to solving backwards in time the Riccati^gquation corresponding to the 
finite time linear regulator problem. The P matrix is initialized 
to any positive semi-definite value at the zero"^^ iteration and updated at 
the k^ iteration using: 


P(k+l)=Q+A^P(k)A-A^P(k)B(R+B^ P(k)B) ^ B^(k)A 


(3.11) 


To illustrate the role of eq. 3.11 in an adaptive mode, assume that 
at some time k, P(k) is already available corresponding to the estimates 
A(k) and B(k) for A^^and B respectively. Since A and B will be 
{^hanging between the k and (k+l)^"^ samples, the estimates A(k+l), 

B(k+l) will be different from the corresponding values at time k. However, 
if these differences are not too severe, then it is anticipated that the 
appropriate value of P which corresponds to the true values of A and B 
at time k can be approximated by evaluating the right hand side of eq. 3.11 
with P(k), A(k+l), B(k+l). 

• Quasilinearization procedure 

A quasilinearization procediire proposed by Hewer^^ for finding the 
steady state solution of (3-9) can be summarized as follows: 

P = lim 

k“K)0 

where satisfies the linear equation 
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(3.12a) 

and « , ™ 


= (E ^ B B)- B V^_^A 

(3.12b) 

= A - B 

(3.12c) 


This procedure requires the selection of such that (A - B L^) = Qq 

is stable. A means for such an initialization has in fact been given by 
Kleinman.^^ Again this procedure can be applied to adaptation by evaluating 
the right hand sides of (3.12) with the most recently computed value for 
and the ciirrently identified values of A and B. 

# First Order parameter expansion 

If between gain update times , the parameter changes M and AB 
are not too large, then the Riccati matrix corresponding to A + AA and B + AB 
(i.e. , P(A + AA, B + AB) can be expressed as a first order expansion about 
P(A, B). This will result in a system of n(n+l) linear equations which 

can then be solved for the n(n+l)/2 elements o? AP = P(A + AA, B + AB) - 
P(A,B). 

These three procedures were evaluated (assuming perfect identifica- 
tion) by: 

. Initializing the P matrix to a value corresponding to a given 
flight condition and evaluating the convergence to neighboring 
flight conditions. Typical per sample changes in A and B 
were considered. 

Initializing the P matrix to zero and investigating the con- 
vergence of the gains as well as the Riccati matrix for 
various flight conditions. This test is an indication of the 
ability for adapting to large parameter changes. Because 
AA and AB are not used, only the first two procedures were 
evaluated in this manner. 

It was observed during the first evaluation procedure that adapta- 
tion based upon the third method, (i.e., first order expansions) was extremely 
inaccurate relative to the other two procedures, both of which performed 
equally well in terms of the number of iterations needed for computing the 
gains to within three figure accuracy. For typical per sample parameter 
transitions, only one, or at most two, iterations of the first two procedures 
were needed to insure three or four figure accuracy in the gains. However, 
because the first procedure required only a formula evaluation, while the 
second procedure required the solution of the n(n+l) components of 

2 

eq. 3.12a, the first or backwards iteration procedure required less computer 
time per iteration. Therefore, the backwards iteration procedure was 
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selected for application to the adaptive system design • 

3.1.1‘2 Single Stage Adaptive Controller 

Development of an implementable digital adaptive control system 
requires that consideration he given to designing a control algorithm that 
performs well, and at the same time is easily adjustable online in response 
to parameter changes- For example, while feedback gains determined from the 
solution to the linear quadratic optimal control problem can be easily 
designed offline, adaptation of these gains, as shown in the previous section, 
requires the online solution of a nonlinear matrix (Riccati) equation. 

An alternative to such a design may be feasible if Erzberger * s^^ 
conditions for perfect model following apply, i.e.: 

(I - B +) (A^ - A ) = 0 (3.13a) 

P P m p 

(I - B^ bJ") B^ =0 (3.13b) 

P P m 


where B is the pseudo-inverse of B . If these conditions are satisfied, 
then the^implicit model following controller: 


u = B“^ (A-A)x + B"‘"B u 
p mp--p pm-m 


(3.14) 


will result in perfect model following. 

However, because these conditions of perfect model following are 
not always attainable in practice and because the gains for perfect model 
following can be too high, single stage performance indices, which penalize 
both the model following effort and the control effort, were considered.^ 

In particular a performance index of the form 


J = e_^(k+l) Q ^(k+l) + u ^(k) R u (k) 

P P 


(3.15) 


where 


e(k+l) = (A X (k) + B u (k)) 
— m — m m — m 


(3.16) 


- (A X (k) + B u (k)) 

P -P P -P 

was minimized to yield the real model following control law: 


u (k) = [R + B^ Q B^] B^^ Q[a X (k) 

P P P HI 

- A X (k) + B u (k)] 
p — p m — m 


(3. IT) 
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Although this controller is attractive because the control gains 
can be readily computed online by formula evaluation » the penalization of 
the behavior only one step into the future makes it impossible to guarantee 
stability. Thus a modification as suggested by Chan^^ was incorporated. 
This results in a real model following control law which yields perfect 
model following if Erzberger’s conditions are satisfied and an error that 
is bounded, otherwise. This controller (for R=0 and Q=l) has the form: 


u 


+ 

(3.18) 


—1 

““2 


= +K 


(3.19a) 

— 1 

= B 

(A-A)x + B*^B u 

( 3 . 1913 ) 

—2 

P 

m p -m pm — m 


e 

= X - 

X 



—m 

-1? 



In a manner similar to Chan’s development for continuous sytems, 
it was shown in ref. l6 that if K is chosen to stabilize (A - B K), 
then the above controller will yield stability at least in tloM senle of 
boundedness even if the conditions for perfect model following are not satis- 
fied. Combining eqs. 3.18 and 3.19 yields the composite controller: 


where 


and 


u=-Kx+K x+K u 
““P — p X -m u ~m 

m m 




(A - A ) 
m p 


+ K 




B 


m 


(3.20a) 


(3.20b) 


(3.20c) 


Clearly online adjustment of the gains in (eq. 3 -19b) can be 

readily accomplished by simple formula evaluation as updated parameter esti- 
mates are received. However, online evaluation of K so as to stabilize 
G = (A^ - B^ K) may not be as straightforward. 

One procedure for stabilizing G is to solve the linear optimal 
regulator problem: 

oo 

Minimize: ^ ~ h I ^^(k) Q ^(k) + u ^(k) R u, (k) (3.2l) 

k=0 
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Subject to: 


e(k+l) = A e(k) + B u (k) (3.22) 

— p — P “1 

Then \mder the conditions that (A , B ) is a controllable pair* R is positive 

definite, Q = DD^, and (A , D) ii obiervable, it can be shown^ that 

P 

= K e (3.23) 


where 


K=+(R + B^PB)^B^PA (3.21t). 

P P P P 

Thus for online adaptation purposes, K might he adjusted using one 
of the procedures discussed in Section 3.1.1.1- 


Alternately, it may he possible through a judicious selection of 
the nominal values for A and B to find a gain K that stabilizes 
G = (A - B K) over the^complete^f light envelope. 


One approach for determining such a gain is to determine a con- 
troller which catisfies the guaranteed cost criterion as stated by Chang and 
Peng24 for continuous systems. In particular, if for a given set of con- 
trollable F and G matrices (appearing in the continuous eq. 2.1.), it is 
possible to ?ind a matrix P > 0 satisfying 


1 

2 





T T 

R u + X P [F X 
P 


G u ] 
P 


< 0 


(3.25) 


where 


u 

P 



( 3 . 26 ) 


then the closed loop transition matrix 


-1 T 

F - G R G P 
P P o 


will be stable for all F 
cost function J, define® 
the guaranteed cost.^^ 


and G^ in the given set. Furthermore, the 


in eq. 


5.21 


will be less than i 


Xp-(O) P Xp(0), 


Substitution of eq.. 3.26 into eq. 3.25 yields 

X X [Q+P G R"^ G P-2 P G R“^ G P+P F +F ^ P] X < 0 
2p'-^o o p o PP P~ 
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This condition holds if P is such that the matrix 

PF +F^P+p[g R“^ G ^ - 2 G R“^ G P + Q 
pp o o p o 

is negative semi-definite for all F and G . Because F and G 
appear separately in this expression? a P matrix satisfyiSg (3.25)^can he 
determined from the matrix Riccati equation 


if 


where : 
and G 


P F + F 


T 


P - P G R 
o 


-1 


G ^ P + Q = 0 
o 



f^ > f^ > f^ ^ ^ maximum absolute eigenvalue of 

is selected such that 

-IT -IT 

G F G < G R G for all G 

O 0—0 p p 


(3.27) 


+ F^^) 

_JE E_ 

2 


(3.28) 


1 -e, 


This latter condition is satisfied if G can be expressed as the product of 
a nominal matrix G and a positive def?nite square diagonal matrix G^^, 

(3.29) 
would be 


n 


G = G G^ 
p n D 


Therefore, for the systems defined in eqs. 2.2-2.U, 
of the form 


"D 




gr 


0 < < gg 


(3.30) 


and G 


can be chosen as 




G 

o 


(3.31) 

with respect to all permissible vari- 


where g^* is the smallest value of g^ 
at ions over the flight envelope. This representation as defined in eq. 3.29 
does not appear unreasonable in view of the given values for G over the 
flight envelope of interest. ^ 
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Application of these procedxires to the discrete optimization problem 
is not as straightforward because it is not possible to separate the effects 
of selecting A from the effects of selecting B . Thus it is recommended 
that either: ^ ^ 


. The continuous feedback gains (eq, 3.26) be used directly 
. in the discrete system. This should be stabilizing if the 
sampling time is not too large. 


or 

. That the equivalent discrete system be found corresponding 
to (F 5 G ). Computation of the control gains would then 
proceeS by^applying eqs. 3.22-3.2^1. 

It should be noted that in applying these procedures, the resulting 
feedback gain may not give desirable transient behavior for all flight condi- 
tions. This can result from the desire to trade off a constant stabilizing 
gain with a time varying gain optimized by some online iterative procedure. 

3.1.1. 3 Comparative Discussion 

Relative to the adaptive optimal regulator controller and the single 
stage adaptive controller respectively discussed in 3. 1.1.1 and in 3. 1.1. 2, 
the following points should be noted: 

. The gain update logic for the single stage algorithm is more 
easily implemented. This is especially true if a satisfactory 
constant feedback gain can be determined that stabilizes the 
open loop dynamics over a fairly wide portion of the flight 
envelop. If however this is not possible and an online 
update of the Riccati equation (3.24) is desired, then it 
should be noted that for a fourth order system, this would 
correspond to the need to update only 10 equations rather 
than the 69 equations (3.9) for the adaptive optimal regulator 
controller. 

. The optimal regulator is more amenable to a redesign for 
implicit model following, since the stabilized single stage 
controller does require feedforward of the model state vector. 

. The optimal regulator design allows penalization of the control 
rate and results in a type one controller which should yield 
better performance with respect to steady state model 
following in the presence of uncertain parameters. 

3.1.2 Implicit Adaptive Controllers 

Implicit adaptive control algorithms are attractive for implementa- 
tion because they do not require the explicit use of parameter estimates. 
Consequently the problem of how to satisfactorily implement online identifica- 
tion is eliminated. 
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Although several implicit adaptive controller have been proposed 
for linear model reference systems, no assurance of stability can be cited 
unless the plant and model satisfy certain structural conditions. Typical 
examples include the ”MIT method", which cannot in general be shown to be 
stable, ^5 the procedure of Winsor and Roy which requires the ability to 
independently adjust each element of the plant matrices, 8 and Landau’s 
hyper stability approach^ which yields asymptotic stability if the plant and 
model matrices conform according to Erzberger’s conditions for perfect model 

following^ 3. 

However, since these conditions for perfect model following are 
not valid for the problem as presented in Section 2.0, it was necessary to 
determine what, if any, modifications were required in order to guarantee 
stability, at least in the sense of a bounded error, if an implicit adap- 
tivetive control algorithm is to be used. 

To this effect, since Landau’s algorithm was general enough to 
have been previously applied to an aircraft model reference control system^, 
its use was attempted in a simulation of the problem defined in Section 2.0. 
Results (presented in Section 4.1.2) indicated that even though the conditions 
of perfect model following did not apply, the adaptive control law was 
capable of improving the performance in the presence of unknown parameters 
and yielding bounded errors. 


Consequently an analytical study was performed in order to deter- 
mine if these results could have been predicted. This was done by defining 
the controller to be of the form: 


u (t) = -K X + K X + K u + 
— p X —p X “m u -m 

p m m 

+ 


|(t)x + 4»(t) u 

— p — m 

(()(t) X + i|^(t) u 


(3.32) 


and applying the Lyapunov function: 

V = P ^ + Trace ((J)-A) Q ^ ((|)-A)*^ + Trace (i|;-B) R~^ (ij^-B)*^ 

where e = x - x 
— m 

• T 

(j) = D e X Q 
P 

ip T R 

^ = D e u 
m 

P, Q, R are positive definite symmetric matrices, and D, A, and B 
matrices to be selected so as to insure stability. 


(3.33) 


(3.3ita) 

(3.3hh) 


are 


29 


T 


Taking the time derivative and selecting D = G P> and using eqs. 2.15 and 
2.16, yields: ^ 


V=2e^[+PF +PG K +D^A]e 

— p P X — 

^ P 

-2e^PG De(x^Qx) 

— p p -p 

- 2 e'^ P G D e(u R u ) 

— p m — m 

+ 2e^P[F-P-GK -GK +d'^A] 
m p p Xp p x^ 

+ 2 e^ [P G - P G K - B] u 

-- m P u -m 

^ m 


(3.35) 


X 


Note that with D=G P, the second two terms will be negative 
definite, and the first term ^ill become: 

2 e^ [P F + P G (K - A)] e 
- P P Xp 

To guarantee that this term.^is negative definite, it is only necessary to 
show that there exists an A such that 


PF +PG(K -A)<0 
P P X 

P 


(3.36) 


since A does not appear in the control law. The existence of such an A 
is evident since, the above requirement for negative definiteness corresponds 
to finding the eight elements of K such that the determinants of the four 
principle minors of p 

-(PF + PG K )-(PF + PG K 

p p Xp p p Xp 


are all positive. 

Since. the last two terms of ■ V involve products of the bounded com- 
ponents of the model state and, control with components of the error ^vector , 
there will exist values of ^ such that the first three terms of V will 
dominate. 

Honsequently, regardless of the initial gain values, , K^, , , the 

control law defined by eqs. 3-32 and 3.3^ will result in st&bilily in\he ^ 
sense of bounded error. However, since D =G P, this controller requires 
knowledge of G which in fact may be unavailable. 
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This can he avoided by defining the augmented state vectors 


x"^^ = 
-p 


(3.37a) 

ag 

X = 

-m 

(x , u ; 
'-m -m 

(3.37b) 


with state equations: 


X 

= F 

X "“S 

+ G ’ 

-P 

P 

-P 

P 

X 

II 

X 

+ G ^ 

-m 

P 

-m 

m 


where 


F = 



F ®' = 

(f 

m 

G ^ 
m 

1 G = 1 

foj 

m 

io 

0 1 

1 m 1 

1 / 


I 

I 


n 


m 


n 

m 


(3.38a) 

(3.38b) 

(3.39a) 


(3.39b) 


m 


An analysis similar to that of eq. 3. 33-3. 35 » but now performed on the augmented 
system results in the stabilizing controller 

(3.i^0) 


u=-K x®'® + K x®'® + K u 
— p X X -m u -m 

p m m 


0(t) X + ^(t) u + (j>(t) X + ip(t) u 
^ -p ^ -m^ — p -m 


where D = P G 


e^^= X 
“ -m 



(3.itla) 

ag 

- X 

(3.J+lb) 

T 

X Q-^ 

“P 

(3.1tlc) 

T T,-l 
u R 

(3.1+ld) 


m 


P, Q, R > 0 
a 

Since is well defined, G^ is no longer needed for computing D. 
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3.1.3 Implementation Considerations 

3.1. 3.1 Actuator Dynamics 

As stated in Section 2.1.2 the computed control signal u (k) is 
in reality applied to a mechanical actuator represented by the dynamics .of 
eqs. 2.9 and 2.10. For the system being considered, the time constants of 
the primary actuators were less than .08 sec, and the time constants of the 
secondary actuators were less than .02 sec. These figures are useful in 
determining the sampling frequency and in ascertaining the importance of these 
dynamics to the design. Since little would be gained by computing a new con- 
trol input faster than the actuator can respond, the control sample period 
should in general be no less than l/lO the smallest actuator time constant. 
Thus, it should be expected that control commands applied more frequently 
will be subjected to actuator filtering. 

With regard to the anticipated effect of the actuators upon the 
behavior of the closed loop system, it should be noted from the actuator data 
given in Section 2.1.2 and the model data presented in 2.1.5, that the two 
dominant lateral actuator time constants of 1/30 and 1/25 B.re significantly 
less than the time constants of l/lO and l/.T which correspond to the eigen- 
values of the lateral model. Similarly the time constant of 1/12.5 associated 
with the elevator actuator is considerably less than the dominant longitudinal 
time constant of l/l.l, and the thrust actuator time constant of 1/5 is less 
than the velocity time constant of 1/1 . Consequently, in the present of good 
model following, it is anticipated that the effect of the actuators will be 
negligible relative to the closed loop dynamics. This in fact has been 
observed from simulations which evaluate the influence of the actuator dynam- 
ics in the overall adaptive system. 

3 . 1 . 3 . 2 Stability 

Although the explicit adaptive control algorithms discussed in 
Sections 3. 1.1.1 and 3.1.1- 2 were designed to be stable, it should be noted 
that this can be guaranteed only if the parameter identification is accurate. 
If however, at some time, the identification is so poor that the correspond- 
ing control gains result in an unstable closed loop system, then the input 
and output signals will become very oscillatory and large relative to the 
measurement noise. With this behavior the parameter estimates should quickly 
converge towards their true values, resulting in a stabilizing effect on the 
system states. Consequently although an analytical proof is not possible, 
it can be expected that while the explicit adaptive controllers may at times 
have rather large outputs, these will be reduced quite rapidly through the 
resulting improvements in identification. 

With regard to stability of the implicit adaptive controller, it 
should be realized that this was designed, independent of the parameter esti- 
mates, for stability in the sense of boundedness of the error between plant 
and model. Clearly the size of this error will be a function of the initial 
control gain, the constants in the gain adjustment logic, and the amount of 
system excitation. 
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3.1.3. 3 Nonlinear Effects 


As stated in Section 2.1. 1.2, it is necessary to realize that 
the linear controller algorithms have in reality "been designed for regulat- 
ing incremental motion about the trim states. Thus, it is to be expected 
that performance will be best for small stepwise perturbations about a con- 
stant trim state. For large and possibly time varying pilot commands, it is 
necessary to compensate for the resulting large incremental motion about trim 
and also for the effects of changing trim states. 

This is partially accomplished by the use of an online identifier 
which yields those parameters which define the incremental aircraft motion 
about trim. Also the use of explicit model following, wherein the model 
trajectory is always used in the controller, tends to compensate' for mis- 
alignments between plant and model due to uncertainties. More specifically, 
consideration must be given to the following situations for which linearized 
model following design is not directly applicable: 

No pilot command; large external disturbance. - In this situa- 
tion the trim states should not be altered by the washout 
filters, and control actions should be such as to return the 
aircraft to trim. Although the linearized equation will not 
be indicative of the actual behavior, the estimated para- 
meters should be usable for computing those control actions 
which will at least reduce the disturbance effects to the 
point at which linearized analysis will again be valid. 

. Large pilot command; no net change in trim (possible for 
certain lateral commands). - The effects of a large pilot 
input, which results in a large deviation about the trim 
state, might be compensated by the identifier and the feed- 
forward of the model state. Alternately, such a command might 
be handled by linearizing the equations (at time k) about the 
previous states and controls (at time k-l). Thus, the control 
action would be designed so as to make the per sample change 
in aircraft motion follow the per sample change in the model 
states. Note that for a step pilot command, the per sample 
change in would be zero for k > 1. 

. Large pilot command resulting in a trim variation. - If the 

pilot command results iii a trim variation, then it is necessary 
to use washout filters with short enough time constants for 
tracking these variations. Thus, with increasing time, the 
incremental variables should decrease, in turn making the 
linearization more accurate. 
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. Variable pilot command. - If over some extended period, the 
pilot command is continuously variable, then it may be 
desirable to have the computer periodically re--initialize the 
model states to those of the aircraft in order to prevent 
large errors which would degrade the control effectiveness. 
This could be performed with a period equal to twice the 
largest closed loop time constant. 

3 . 1 . 3 .^ Performance Index Weighting Factor Selection 

The performance indices (eqs. 3.3a and 3.21a) for the explicit 
adaptive controllers both contain weighting matrices Q and R which 
penalize respectively undesirable state trajectories and excessive control 
signals. These were chosen experimentally according to the following con- 
siderations: 


Good following of the two lateral states p and g and of at least 
two of the longitudinal states q, V, and a. 

Constraints on the control signals - 


-27.6° < < 6.5 ; 


6al < 30°. 


6 I < 6" 

r 


. Restriction of the gain values to be such that instabilities 
do not occur because of actuator nonlinearities . 

A constant pair of weights Q, R which can be used over 
the entire flight envelope. 

One approach towards the selection of Q and R was to weight only 
those states of interest and then through a series of simulations decide on 
the proper ratios. As an example, this procedure resulted in the selection: 


i 
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for longitudinal motion. 
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An alternate approach found to be equally effective was to restrict 
Q and R to again be diagonal with elements: 


-1 


q^^ = [maximum ] p^ 


-2 


-1 


r, . = [maximimi u. ] 

11 1 


where p. is a weight used to indicate tolerable percentage errors in model 

following. For lateral motion, the maximiun assumed values for p, r, <p 9 

6 , 6 were respectively 6.98 r/s, .873 r/s, .3^9r, .873r, .873r (i.e., 

a r 

6 =6 


'MAX 


MAX 


)» for = .01, Pg = .10, and p = .01, 






/ 200 . 

0 
0 

For longitudinal motion the maximtun assumed values for q,, V , a, 
0, 6 , 6 , were respectively 1.75 r/s, 2000 f/s, .^2kr, «, .873r, 100^. 



5 9 ; 

Then^fori 


P-, = .01, p = .01, and p = .10, 


\ = 


^ 3280 . 

0 

0 

\ « 


0 0 

.0025 0 

0 36k. 

0 0 


0 

0 

0 


0 / 



.01 


In addition to studying the relationship between Q and R and 
model following errors in the four lateral and four longitudinal states, it 
was also important to consider the behavior of the vertical acceleration 


n, = f (q-a) 


This can indirectly be considered by a Judicious choice of the weights on q 
and a. Alternately n can be expressed as a linear transformation of the 
state variables themselves, and then included in the performance index. 

Note, however, that since n^ and V are functions of a, the corresponding 
transformation will vary with flight condition changes. 

Examination of results obtained by penalizing n and V 
simultaneously, revealed that the resulting improvements in n^ behavior 
were not significant enough to warrant its inclusion into the performance 
index. 
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3.2 Estimation Procedures 

In designing a procedure for state and parameter estimation, it 
should he noted that algorithms can he classified according to whether or 
not states and parameters are estimated simultaneously or separately. Where- 
as the problem of simultaneous estimation is nonlinear because of the need to 
determine quantities that miiltiply each other (parameter times state), the 
procedures for separately estimating states and/or parameters are linear. 

To this effect, following a formal statement of the estimation 
problem. Sections 3-2.2 and 3-2.3 discuss linear procedures which are used 
when state estimation is performed separately from parameter identification. 
Following this presentation. Section 3-2.4 discusses the extended Kalman 
filter which can be used for simultaneous estimation of both states and para- 
meters. Finally, Sections 3-2.5 and 3-2.6 respectively compare and discuss 
the implementability of the proposed algorithms, 

3-2,1 Problem Statement 

The problem considered is that of determining the values of certain 
parameters appearing in the discretized aircraft equations of motions given 
exact measurements of the inputs and noisy measurements of the outputs. As 
given in eq. 2.155 the lateral or longitudinal motion of the aircraft can be 
represented by the vector difference equation 

X (k+1) = A (^) X (k) + B^(£) u (k) (3.42) 

where _q is now used to denote a vector whose elements are unknown para- 
meters appearing in the discrete plant matrices. For estimation purposes, 
it will be assumed that the system measurements can be described by 

jr^(k) = H Xp(k) + n(k) (3-43) 

■where: n,(k) is a vector of independent correlated noise sequences 

with statistics as defined in Appendix B. 

and H is a selector matrix indicating just which states or 
combinations of states are measured. For the problem 
considered, all states were assumed measureable , and 
hence H = I, the identity matrix. 

3-2.2 Weighted Least Squares Identification 

Since as indicated by eq. 3-43 the state measurements are corrupted 
by measurement noise, both state and parameter estimates are needed, the 
former for control computation and the latter for the gain computation. If 
the parameters were known, state estimation could be performed using a linear 
filter derived by minimizing a conventional weighted least squares performa- 
ance index. Similarly if the states were available, parameter estimates 
could also be obtained using a linear weighted least squares estimator. 
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This leads to a tvo-step procedure at each sample time i; namely: 

Step l) An estimate for the parameter vector £_(i) 
is computed using the measured values y^(i) 
and y^(i-l) for x (i) and x (i-l) 
respectively. 

Step 2) An estimate for the state vector 
computed "based upon the matrices 

B (£(i) ) . 

P 

^ An alternate procedure for step l) in which the estimates x (i) 
and X (i-l)i rather than the measurements were used, was observed to ^eld 
poor ^rformance. This result was not surprising since large errors in 
X due to initialization and the subsequent transient response of the 
iHentifier, can in turn cause large errors in The proposed approach 

however as outlined in step l) and developed below is completely independent 
of errors arising from state estimation. In fact, a similar procedure was 
shown by Anderson et. al, for stable open loop systems, to be consistent 
for both state and parameter estimation.^T" 

For identification purposes , the time-varying aircraft parameter 
changes were modelled as fictitious noise disturbances according to the 
di f f er enc e equat i on : 


F 


is 


(i) 
(£(i)). 


3 ^(i) = ^(i - l) + w(i - l) (3.^^) 

where w is a white Gaussian noise vector with zero mean and covariance 
matrix W. 

Eq. 2.1 can then be rewritten in terms of as: 

x (i + l) = C(i) _q(i) + D(i) s (3.^5) 

where ^ and ^ are the vectors containing the unknown and the known 
elements respectively of the A and B matrices, and C(k) and D(k) 
contain the appropriate measureS control^and state values. A pseudo- 
measurement vector ^ is then defined as: 

^(i) = - 1) ^ (3-^6) 

where defined in eq. 3-43. Estimates _q(k) for the unknown 

paramet^ vector ^(k) can now be determined by forming C and D from the 
available measurements and minimizing:^® 


J = ^ U(i+1) - C(i) 5^(i)) N"^ U(i+1) - C(i) ^(i)) (3.i+7) 

i=0 

where N is an apriori chosen weighting matrix. 
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The resulting estimates are then defined by: 

i(k+l) = i(k) + K^(k+l) (^(k+1) - C(k) i(k)) (3.W 

K (k+1) = P (k+l/k) C^(k) [N+C(k) P (k+l/k) c''^(k)] (3.US 

q q q 

P (k+l/k) = P (k) + W (3.5C 

q q 

P (k+l) = P (k+l/k) - K (k+l) C(k) P (k+l/k) (3-5:i 

q q q q 

Note that the fictitious noise covariance matrix W keeps P , the para- 
meter covariance matrix, from getting so small that the param^er updating 
becomes insignificant. 

As defined, this identification procedure will yield biased esti- 
mates because of the statistical dependence between the noige in z(i), 
i = 1, K and the components of C(i),i=l, ^ 

For state estimation as required in Step 2), the index 

j = 1 (z.(i) - X (i:(i) - (3.52 

i=0 ” ^ 

is minimized subject to: 

X (i+l) = A (£(i)) X (i) + B (^(i)) u (i) (3-5: 

~P P ~P P “P 


gxving: 


X (k+l/k) = A (£,(k)) X (k) + B (^(k)) u (k) 

-p P ^ “P P “P 

X (k+l) = X (k+l/k) + K (k+l) [^(k+l) - x (k+l/k)] 
-p ~P X -p 

K (k+l) = P (k+l/k) [r + P (k+l/k )]"^ 

X X X 

P (k+l/k) = A ^(i(k)) P (k) A (i(k)) 

X p X p 

P (k+l) = P (k+l/k) - K (k+l) P (k+l/k) 

XX XX 

3.2.3 Minimxun Variance Identification 


Whereas the weighted least squares identifier discussed in the 
previous section, neglected the measurement noise contained in C(i) and 
D(i) as defined in eq. 3.^5, it is desirable to develop an alternate 
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identifier based upon a minimum variance index. To illustrate this approach, 
it will be assumed that the measurement noise is uncorrelated, i.e.. 


£ Csi 


= E 
= 0 


if 

if 


i = J 
i ^ i 


(3.59) 


and that the parameter ^ is deterministic and constant, i.e., 
^(k+l) = ^(k) 


( 3 . 60 ) 


As in the previous section, a linear identifier will be developed. 
However, identification will now be performed every other sample period so 
as to alleviate some of the statistical dependency problems which arise 
because of the multiplicative noise inherent in the product C(i) ^(i) of 
eq. 3.1t5.30 


Thus defining the identification algorithm to be: 
i(k+l) = i(k-l) + K^(k+1) [^(k+1) - C(k) i(k-l)] 


( 3 . 61 ) 


it is necessary to determine so as to minimize: 


J = I C (%(k) - %(k))' 


( 3 . 62 a) 


which is the trace of the covariance matrix 


£ [cL(k) - ^(k)] [^(k) - i(k)]^ 


( 3 . 62 h) 


This matrix can in a straightforward manner be formed by substituting eq. 

3.6i into eq. 3 . 62 b. 30 The resulting minimization of J with respect to 
elements of the gain matrix yields: 30 

K (k+1) = P (k) C^(k) (c'^(k) P (k) C(k)+V+R (k))"^ (3.63) 

q q q eq 

P^(k+1) = P^(k) - K (k+1) C(k) P„(k) (3.64) 

<1 q q q. 

where 

V = £[C(rij^) qq"^ C^(nj^)] (3.65) 
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Rgjk) = R + <£ [D(n^) S(k) S^(k) D^(nj^)] (3.66) 

and denote the nondeterministic portions of C 

and D fas defined in eq. 3.45). 


These equations, except for V and the additional tem in R 

are identical to eqs. 3.54-3.58 if W is set to equal to zero and the 

weighting matrix DT is replaced by (V. + R ) • . . 

eq 

In practice V can be computed using either the initial estimate 
or the most recent estimate for 

Although this linear minimum variance algorithm as given by 
eqs. 3 . 61 - 3.665 will still yield biased estimates, it is possible to alter 
eq. 3.61 so that the estimate for q will be at least asymptotically 
unbiased, i.e. , 

Lim ^ (1, ) = 2 . 

k-K» ^ 


This will be true if the prediction term in eq.'3.6l is modified, resulting 

in: 30 


q(k+l) = (I + P^(k+l)^[C^(n^) [R^^ + V] CCn^^)] q(k-l) (3.6?) 

+ K^(k+1) (^(k+1) - C(k) i(k-l)) 

In a similar manner, it can be shown that the minimum variance esti- 
mator for the states taking into account the parameter uncertainty is defined 
as follows : ^0 


X (k+l/k) 
“P 

= A (^(k)) 5 (k) + B (^^(k)) u (k) 
P T P “P 

(3.68) 

X (k+l) = 
“P 

^ (k+l/k) + K (k+l) [jr(k+l) - 1 (kn/k)] 

^p X — p 

(3.69) 

K^(k+1) = 

P^(k+l/k) [r + P^(k+l/k)]"^ 

(3.70) 

P^( k+l/k) 

= aJ (q(k)) P (k) A (t(k)) 
P P 

(3.71) 


+ £[C(x(k)) P^(k) (x(k))] 
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Comparison with the weighted least squares state estimation algor- 
ithm eqs. 3 . 54 - 3.58 shows that the predicted covariance (eqs. 3.57 and 3-7l) 
is increased by the additional term: 

^[C(x(k)) P^(k) c'^(x(k))] 


where 


P 


q. 


is as defined in eq. 3.64. 


3 . 2.4 Extended Kalman Filter 


To simultaneously estimate both the states x , and the unknown 
parameters ^ appearing in the state transition matri? A and the gain 
matrix B , "^it is necessary to form an augmented state vector. This is done 
by append?ng to the aircraft equations (2.15) the parameter equation 3.44. 

Then the augmented system, becomes : 

x^(k+l) = A^(x^(kK k) + B(x^(k), k) u(k) (3.72) 

y_(k) = H^(k) x^(k) + n(k) (3.73) 


where 


a 


X 


= augmented state vector. 


given by 


X 



q 



S<3-> 


^2 


I 

P 


0 


and 


H 


.a 


= the augmented system 


output matrix given by 


(3.74) 


[h j N3] 

I is an identity matrix of dimension (p x p), and and are 

nBll matrices with dimensions of (n x p), (p x n) and (n x p) 
respectively. 
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To estimate the augmented vector x; 
necessary to linearize eq. 3-72 about some nominal trajectory (x 
Denoting 


using a Kalman filter, it is 
o „o\ 
j 5L * * 



a o 

X - X as 

A X 

(3.75) 


“P -T 

-P 


o 

as 

A 2 . 

(3.76) 

and 

y(i) - H X ^ as 
"T> 

Az. 

(3.77) 


the linearized versions of eqs. 3.72 and 3*73 become: 

3 

A X (i+l) = A (q°) Ax (i)+ -r {A (q) x +B (q) u }■ A q (3.78) 

— p p-^ — p 3q p-^— pp-^-Po 


A 3^(i+l) = A ^(i) (3.79) 

A y(i) = H A x(i) + n(i) (3.80) 


These equations which are linear in Ax and in A q are now 
amenable to linear weighted least squares estimatiBn of the augmented state 
(A X , A q). If the nominal trajectory (x > ^ ) is always updated to 
corrispond with the most recent estimate, i?e. , 


X °(i-l) = x^ (i-l/i-l) 

^ -P 

X °(i) = A (^(i-1)) X °(i-l) + B (l(i-l))u (i-l) 
-p P -P P P 

£°(i-l) = q(i-l/i-l) 

^° ( i ) = ( i-1 ) 


(3.81) 

( 3 . 82 ) 

(3.83) 

( 3 . 84 ) 


then the resulting filter 


equations become: 


.18,31,32 


/yi/i)| 


X (i/i-l) \ + K(i) (jr(i) - H x (i/i-l)) (3.85) 

~P “P 

£.(i-l/i-l)/ 
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where 


^(i/i-l)=A^(i(i-l/i-l)) ^(i-l/i-l)+Bp(i(i-l/i-l))Up(i-l) (3.86) 


K(i) = P(i/i-l) [H®’(i) P(i/i-l) + B] 


,T,_. 


1-1 


(3.87) 


P(i/i-l) = J(i) P(i-l/i-l) j'^(i) 


( 3 . 88 ) 


P(i/i) = P(i/i-l) - K(i) H^(i-l) P(i/i-l) 


(3.89) 


and 


J(i) = 


Ap (a.(i)) 


3 q 


[a (q) X + B (q) u ] 
P P P P 


X °(i) 
-P 

£°(i) 


(3.90) 


With regard to the convergence of this algorithm, it can be shown 
that if the initial errors between the estimated and the true values are 
sufficiently large, the estimates as defined by eqs. 3.85-3-90 will diverge.*^ 
This behavior follows from neglecting the nonlinearities which can propagate 
through the computations as systematic noise. Such behavior was in fact 
observed in several computer simulations. 

3.2.5 Comparative Discussion 

Taking into account convergence properties, requirements for 
implementation, and observed performance in simulation experiments, it is 
recommended that the weighted least squares algorithm as discussed in 
Section 3.2.2 be utilized. 

Although as shown in Section 3.2.3, the minimum variance procedures 
do take into account the system noise and at the same time can be imple- 
mented almost as easily as the weighted least squares procediires, it was 
noted during simulation, that the minimum variance state estimates were not 
accurate enough for effective control computation. This is the result of 
including in the computation of P (eq. 3-70) the parameter uncertainty 
P . Thus a large initial value of^ P (which is needed for rapid conver- 
gince of the parameter estimates) can ^immediately cause the state estimates 
to track the measurement noise. However, it should be noted that the para- 
meter estimates obtained from the minimum variance procedures were signifi- 
cantly better than those resulting from either the extended Kalman filter 
or the weighted least squares procedures. 
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The extended Kalman filter is not recommended for implementation 
primarily because of its divergent properties in the presence of large para- 
meter errors^^ and secondarily because of its relative complexity. Since it 
is possible for the aircraft to change flight conditions without sufficient 
excitation for identification, it is indeed probable that in the presence of 
a pilot command, the parameter errors will be large enough such that diverg- 
ence will occur. Such large errors have in fact been observed in simulation 
experiments . 

3.2.6 Implementation Considerations 
3 . 2 . 6 . 1 Ident if iability 

In order for the parameter estimates to be meaningful, it is neces- 
sary that the overall structure and excitation be such that the system is 
identifiable. For the problem defined by eqs. 3.46 and 3.43, it has been 
shown that 3 2 


If the only parameters to be identified are elements 

of A , then no restrictions are needed. 

P 

If elements of B are to be identified then the control 
inputs u^ ^ must-be independent . 


In addition to these necessary conditions, it is also desirable to 
consider control inputs for optimizing the performance of the identifier. In 
particular, if these inputs are to be found so as to maximize the weighted 
trace of the Fisher information matrix, then it can be shown that the optimal 
energy constrained input can be defined by the eigenvalues and eigenfunctions 
of a two point boundary value problem. However, because of the com- 
plex nature of this problem and the need to restrict external inputs so as 
to be imperceptible to the pilot, such an approach was not pursued. 


Thus, as sources for sufficient excitation of the identifier, only 
the following were considered: 

. On-off type dither inputs (discussed in 3.26). 

Pilot commands. 

. Large and oscillatory motions resulting from control 
gains computed from poor parameter estimates. 

3. 2. 6. 2 Influence of Inputs Other Than Pilot Commands 


Implementation of an online identifier requires that consideration 
be given not only to behavior in the presence of pilot commands, but also to 
the behavior resulting from dither, gusts, and sensor noise. 

To assess the effects of dither, square wave signals with random 
switching times were studied for their utility in improving the identifica- 
tion especially during periods of steady flight motion. However, with the 
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restriction that the switching frequency and the dither magnitude be such 
that the resulting effects be imperceptible to the pilot, the resulting 
dither signals were found to be non-influential in the noise environment 
defined in Appendix B. Despite this, it was noted that the feedback of the 
filtered measurement noise itself did offer some improvements in parameter 
tracking. 

Although no significant dither could be applied to the air- 
craft during a steady transition between flight conditions, it was conjec- 
tured, and shown by simulation, that if the aircraft changes flight con- 
ditions without proper tracking by the identifier, then in response to a 
pilot command, 'the aircraft may undergo large oscillatory motion due to 
improper control gains. This would then have the effect of exciting the 
identifier enough to result in rapid estimation of the proper parameter 
values. Such behavior was indeed observed even when the initial parameters 
were such as to produce control gains which destabilized the system. Oscil- 
lations were in these cases observed to be eliminated within seven seconds. 

The effects of gust disturbances can be assessed by reconsidering 
the longitudinal equations modified as in eq. 2.l4 to account for gusts: 

x=Ax+A(3)Aa+Bu (3.9l) 

P T) P P T> 

Thus if a wind sensor is used so that A a is available, then the gust can 
be regarded as an additional excitation aiding the identification. However, 
it is anticipated that the effects of such gusts will be dampened out since 
the controller is designed so as to reduce the error between plant and 
model (which is itself not excited by the gust). 

If the gust disturbance A a is not measured then it should be 
modelled as a process noise term added to the aircraft equation. 

Concerning sensor noise, it was observed that the specifications 
cited in Appendix B were such that the response contained some oscillations 
due to the filter’s inability to completely smooth out the included effects 
of the bending modes. A reduction of the noise levels to one tenth of the 
Appendix B values did however result in significant improvements. Although 
the estimation algorithms considered did not take into account the cor- 
related nature of the sensor noise, it was observed that the simulation of 
uncorrelated measurement noise sequences did not result in any noticeable 
improvement . 


3 . 2 . 6 . 3 Initialization 

In designing estimation logic for an adaptive controller, it is 
necessary to detemine initial values for the state and parameter estimates, 
the corresponding covariance matrices, and the parameters W and R as 
defined in eq. 3-44 and eq. 3*52 respectively. To this effect the following 
guidelines have been determined through simulation efforts: 
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Initialize parameters equal to their average values 
as computed over the flight envelope. 

. Initialize the states equal to the measured values. 

. Select the initial variance of each parameter estimate 
to be in proportion to the square of three times its 
largest possible value. A factor of 10^ times these 
values vas observed to yield satisfactory convergence. 

. Select the initial variance of each state to be zero 
if the initial state values are well defined. 

. Select R anywhere between one and five times the 
actual noise covariance matrix. 

. Select the elements of W equal to three times the 
expected square of the per sample change in each of 
the identified parameters. 

In addition, so that the identification does not become too complex 
and time consuming, it is desirable to select which parameters need to be 
identified and which can be allowed to remain at the average value. A sensi- 
tivity procedure which uses the state sensitivity vectors 9 x /8 q to 
predict the change Ax in x resulting from a corresponSng parameter 
change A ^ showed tha? only 3ght to twelve parameters need be identified 
for either the longitudinal or the lateral control system.^ 

h. EXPERIMENTAL RESULTS AND DISCUSSION 

Evaluation of the proposed digital adaptive flight control systems 
was based upon a series of simulation experiments performed on Rensselaer’s 
IM 360/67 computer and on NASA Langley’s CDC 66 OO computer. These experi- 
ments considered the application of the controllers to both the linearized 
equations of motion (as presented in Section 4.l) and the nonlinear six- 
degree-of- freedom simulation^^ (as presented in Section 4,2). 

4.1 Linear System Evaluation 

Because of the need to examine the required preciseness of identi- 
fication and the degree of adaption needed, a typical flight trajectory in 
the altitude-mach number plane was postulated. This is defined in Appendix C 
which cites the order and timing for a typical fighter aircraft to encounter 
the six given flight conditions of Appendix A. This trajectory corresponds 
to an initial acceleration from Mach .3 to Mach .9 at a very low altitude, a 
combined climb to 36 OO m and acceleration to Mach 1.1, a climb to 15,000 m, 
a deceleration to Mach .9, and finally a combined dive to 6 OOO m and a 
deceleration to Mach .7* For simulation purposes, it was assumed that the 
parameters of the aircraft’s discrete A and B matrices varied linearly 
with time between these flight condition^. ^ 
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As stated in Section 3.2.6. 3, it is impractical, for explicit adapta- 
tion, to consider the identification of all parameters of the A and B 
matrices. A sensitivity study as discussed in reference 6 was therefore ^per- 
formed to determine those parameters which least effected system performance 
and which might therefore he considered constant. This effect upon system 
performance considered not only the sensitivity vector hut also the possible 
change in each parameter. Thus even if a particular parameter is highly 
influential, it could he excluded from identification if its expected varia- 
tion is negligible. 

Results of this study suggested that for lateral motion, the follow- 
ing eleven parameters he set to their average values and thus not he identi- 
fied: 


A A (2,1), A (2,2), A (2,4), A (4,l), 

XT sr ^ ^ XT 

Ap(4,2), Ap(4,3), Ap(4,4), Bp(2,l), Bp(4,l), Bp(4,2) 

Additional parameters might he included in this list according to the partic- 
ular pilot command being applied. 

For longitudinal motion, the parameters not identified and there- 
fore frozen at their average values included: 

A^(l,2), A^(l,4), A (2,1), A^(2,2), A (2,4), A (3,l), 

P P P P P P 

A (3,2), A^(3,4), a (4,1), A^(4,2), a (4,4), B (l,2), 

P P P P P P 

Bp(2,l), Bp(2,2), Bp(3,2), B^(4,2) 

Prior to testing the explicit adaptive controllers with the identi- 
fication logic an evaluation of the gain update logic itself was made under 
the assumption of perfect identification of various influential sets of time 
varying parameters.^ This study, based upon the trajectory defined in 
Appendix C, resulted in the suggestion that gain adaptation he performed once 
every second and that the control signal itself he updated every 0.1 to 0.2 
seconds.^ These results were based upon reponse observation and therefore could 
he altered by pilot opinion. 

h.1.1 Adaptive Optimal Linear Regulator Results 

Results pertaining to the performance of the adaptive optimal linear 
regulator controller applied to the linearized lateral equation of motion may 
he found in references 6 and 17. Therefore, the following description is 
concerned only with the behavior of the adaptively controlled linearized 
longitudinal equations of motion. 
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013,1 ective ; 


To study, using linearized longitudinal equations, the behavior of 
the adaptive optimal linear regulator discussed in Section 3- 1-1.1 . 

Procedure : 

Using noisy state measurements, parameter estimates -were obtained 
at each control sample period and then used at each gain update sample in 
one iteration of the Riccati equation (2.9). The gains were then computed 
and used for control computation. Performance with and without state 
estimation was considered. 

Constant Factors : 

Pilot input: .1 radian elevator, 0.2 Hz square wave 

Control sample period: 0.1 sec. 

Gain adaptation period: 1 sec. 

Identifier: weighted least squares (Section 3.22) 

Parameters identified: A (l, l), A (l, 3), A (2, 3), A (3, 3), 

P P P P 

3), B (1, 1), B (3, 1), B (i^, 1) 

P P P P 

Initially set equal to their true values. 

Remaining parameters: Set at their average values as computed 

over the 6 PCS. 

Measurement noise: as stated in Appendix B 

Control index weights: and R^ as defined in Section 3-1.3.^ 

Results and Discussion; 


Because of the relatively low variance inherent in the longitudinal 
sensors, the use of a state estimator was observed from the initial simula- 
tions to be unnecessary and was therefore omitted in subsequent experiments. 

Figures 4.1— ^.7 depict the state responses, vertical acceleration, 
and controls while Figures 4.8-4.10 give the identified values for three of 
the eight parameters being tracked. Corresponding feedback gains are shown 
in Figure 4.11. 

These figures and observations made beyond the illustrated records, 
indicated the capability for tracking the gain variations, thus resulting in 
acceptable V, a, 0, responses. It was further observed that of the 
eight parameters being identified, six were noted to track reasonably 
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TIME SEC 

PITCH RATE RESPONSE TO 0.1 RAD,0.2hz ELEVATOR COMMAND, 
ADAPTIVE OPTIMAL REGULATOR (SECTION 4.1.1) 
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FIG. 4.2 VELOCITY RESPONSE TO 0.1 RAD,0.2hz ELEVATOR COMMAND, 
ADAPTIVE OPTIMAL REGULATOR (SECTION 4.1.1) 
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FIG. 4.3 ANGLE OF ATTACK RESPONSE TO 0.1 R AD, 0.2hz ELEVATOR 
COMMAND, ADAPTIVE OPTIMAL REGULATOR (SECTION 4.1.1) 
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FIG. 4.4 PITCH RESPONSE TO 0.1 RAD 0.2 hz ELEVATOR COMMAND, 
ADAPTIVE OPTIMAL REGULATOR (SECTION 4.1.1) 
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FIG. 4.5 VERTICAL ACCELERATION RESPONSE TO 0.1 RAD 0.2 hz, 
ELEVATOR COMMAND, ADAPTIVE OPTIMAL REGULATOR 
(SECTION 4.1.1) 
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FIG. 4.6 PILOT COMMAND AND AIRCRAFT ELEVATOR INPUT, ADAPTIVE 
OPTIMAL REGULATOR (SECTION 4.1.1) 




TIME SEC 

FIG. 4.7 AIRCRAFT THRUST INPUT IN RESPONSE TO A 0.1 RAD,0.2hz 
ELEVATOR COMMAND, ADAPTIVE OPTIMAL REGULATOR 
(SECTION 4.1.1) 


\J] 

\J1 


TIME SEC 

FIG. 4.8 

PARAMETER Ap(l,l) FOR LONGITUDINAL ADAPTIVE OPTIMAL REGULATOR, 
PILOT COMMAND =0.1 RAD, 0.2hz ELEVATOR (SECTION 4.11 ) 
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FIG. 4.9 PARAMETER Ap(2,3) FOR LONGITUDINAL ADAPTIVE OPTIMAL 

REGULATOR PILOT COMMAND =0.1 RAD, 0.2 bz ELEVATOR, 
(SECTI0N4.I.I) 
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FIG. 4.11 FEEDBACK CONTROL GAIN ADAPTATION LONGITUDINAL 
ADAPTIVE OPTIMAL REGULATOR, PILOT COMMAND = 
0.1 rad,0.2hz ELEVATOR (Section4.l. I ) 
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veil, whereas A ^ and were observed to have erratic responses. How- 

ever, the model rollowing being acceptable indicates that these two parameters 
were not influential to elevator excitation. 

U.1.2 Single Stage Adaptive Controller Results 

Several simulation experiments were performed using the single 
stage adaptive control logic with the lateral equations of motion in order to: 

. Compare the performance with that of the adaptive optimal 
regulator logic. 

Evaluate the feasibility of not adapting the feedback gain 

K (eq. 3.24). 

. Assess the different identification algorithms presented in 
Section 3-2. 

. Assess performance in the presence of highly erroneous 
parameter estimates. 

Some of the more salient of these procedures follow: 

Experiment I 
Objective : 


To compare using lateral motion, the behavior of the stabilized 
single stage adaptive control system with the adaptive linear optimal regu- 
lator, when the number of identified parameters for each controller is 8 
(rather than 12). 

Procedure : 


Both parameter and state estimates were obtained at each control 
sample period using the weighted least squares procedure discussed in 
Section 3-2.2. Feedback gains for the single stage controller were adapted 
using the Riccati update procedure described in Section 3 -1-1- 1-2. 

Design Factors : 

Pilot input: ^ 5° Aileron, 0.2 Hz square wave 


Control sample period: 0.1 sec. 

Gain update period: 1.0 sec. 


Parameters identified: 

A 

12’ 

^31’ 

^34 

B , 

B , 

B , 

B 

11’ 

12’ 

22’ 

31 
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Results and Discussion; 


Fig. U.12 depicts the roll rate responses for the single stage and 
the optimal regulator adaptive control logic. Corresponding roll rate feed- 
back gains are shown in Fig. 4.13* 

Observation of these curves (and other associated data) indicates 
that while both adaptive control algorithms are equally capable of generat- 
ing the desired behavior, the single stage gains were slightly larger than 
those of the optimal regulator. 

Experiment II 

Objective : 


To investigate the feasibility of not adopting the feedback gain 
in the single stage controller. 

Procedure: 


As in experiment I, weighted least squares procedures were used for 
both state and parameter estimation. Using the trajectory defined in 
Appendix C, and the lateral equations of motion, three cases were considered, 
namely: 

1) Adapting the feedback gain K according to the procedures 
discussed in Section 3. 1.1. 2. 

2) Fixing the feedback gain K so that it is stabilizing for 

all flight conditions. This was done using eqs . 3.23, 3.24 
for the A of flight condition 3 and the B for flight 
condition S, and the weights Q^, from Section 3.1. 3. 4. 

3) Fixing K in accordance with the procedures described by 
eqs. 3.25-3.31. 

Results and Discussion : 

Figure 4.l4 which depicts the roll rate response for cases l) and 
2) shows that it is possible to select a feedback gain that eliminates the 
need for adaptation. Further tests which considered the effects of an 
unstable initialization in fact re*vealed better initial performance when 
the fixed feedback gain was used. Additional tests using no feedback gain 
at all (which is stabilizing since the given loop lateral dynamics are 
inherently stable) were, as expected, unsatisfactory. 


With regard to the determination of a fixed feedback gain using the 
guaranteed cost procedures defined in eqs. 3.25-3.31, it was found that in 
order to satisfy these conditions, the feedback gains would be excessively 
large (on the order of lO^). 
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FIG. 4.12 ROLL RATE RESPONSE FOR OPTIMAL REGULATOR AND 

STABILIZED SINGLE STAGE ADAPTION LOGIC, 8 PARAMETERS 
IDENTIFIED (SECTION 4.12. EXP. I) 
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FIG. 4.14 ROLL RATE RESPONSE STABILIZED SINGLE STAGE CONTROLLER 
WITH AND WITHOUT ADAPTATION OF THE FEEDBACK GAIN 
(SECTION 4.1.2, EXP.It) 



Experiment III 
Ob.jective : 


To assess the performance of different state and parameter estimation 
algorithms when parameter estimates' are initially 50^ of the corresponding true values. 

Procedure : 

Using the noise sequences defined in Appendix B, estimation was per- 
formed with the weighted least squares, minimum variance and extended Kalman 
filter procedures. Control was achieved using the stabilized single stage 
algorithm with all gains being adjusted. The aircraft was simulated to be 
fixed at flight condition 2. Those parameters being identified were initial- 
ized at 50 ^ of their true values. 

Constant Factors : 

Gain adaptation period: 0.2 sec- 

Control sample period: 0.2 sec. 

Parameters identified: 1st and 3rd rows of A , B 

P P 

Pilot input: 5^ aileron, 0.2 hz square wave 

Results and Disucssion : 

Roll rate responses achieved using the weighted least squares 
algorithm and the extended Kalman filter are shown in Figures U.15 and U.16 
respectively. These results indicate that although both algorithms were 
capable of recovering from the erroneous initial conditions, the weighted 
least squares procedure was much more responsive. This, in fact, was 
reflected not only in the depicted responses but also in the adapted values 
for the gains. 

With regard to the effects of using the minimum variance algor- 
ithm, it was observed that the roll rate response was initially very 
oscillatory, and that the parameter estimates and corresponding adapted gain 
values were closer to their true values than those computed using the 
extended Kalman filter and the weighted least squares procedure. The initial 
oscillation in roll rate can be explained by noting from eq. 3.71 that the 
initial uncertainty in the state estimates, P is directly related to the 
parameter uncertainty P . Thus an initial high uncertainty in the para- 
meter can result in stat^ estimates that tend to track the measurement 
noise. Because the control signal itself includes products of the adapted 
gains with the state estimates, the poor initial state estimates tend to 
degrade the overall response. 
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FIG. 4.16 STABILIZED SINGLE STAGE ADAPT 
EXTENDED KALMAN ESTIMATION 
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Experiment IV 
Objective : 

To study the capability for recovering from a set of erroneous para- 
meter estimates which yield a set of destabilizing gains. 

Procedure : 


Weighted least squares procedures were used for both state and 
parameter estimation in the presence of measurement noise sequences as 
defined in Appendix B. All parameter estimates were initialized at the aver- 
age values as computed over the six given flight conditions, when in reality 
the aircraft was initialized at flight condition 2. The corresponding initial 
gains were such that the closed loop system was initially unstable - 

Constant Factors : 

Gain adaption period -0.2 sec. 

Constant sample period = 0.2 sec. 

Parameters identified: 1st and 3rd rows of A and B . 

P P 

Pilot input: 5^ aileron, 0.1 hz square wave 

Results and Discussion: 


Figures ^.17 5 U. 18 , 4.19 respectively depict the roll rate response, 
the estimates for B (l,l), and the roll rate and sideslip feedback gains 
for the situation in^which the aircraft remains at flight condition 2. Similar 
responses (except for the gains) are given in Figures 4.20, 4.21 for the case 
in which the aircraft continues along the trajecccry defined in Appendix C. 

The results show that even with the use of initially unstable gains, 
the system is able to adapt to a stable operation. This is due to the 
excellent response of the identifier to a very large and rapidly varying 
signal. This, as shown in Figure 4.19, leads to a set of control gains which 
are quickly adapted towards their optimal values - 

4 . 1.3 Implicit Adaptive Controller Results 

The feasibility of using an implicit adaptive flight controller was 
examined by applying the controller of eq. 3.32 to the linearized lateral 
equations of motion. To this effect Figures 4.22 and 4.23 show the potential 
of this method for improving the model following for the following conditions: 
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FIG. 4. 19A ROLL RATE FEEDBACK GAINS. STABILIZED SINGLE STAGE 
CONTROLLER. FLIGHT CONDITION 2. INITIAL PARAMETERS 
AT AVERAGE VALUES (UNSTABLE INITIALIZATION) 
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FIG. 4. 19 B SIDESLIP FEEDBACK GAINS, STABILIZED SINGLE STAGE 
CONTROLLER, FLIGHT CONDITION 2. INITIAL PARAMETERS 
AT AVERAGE VALUES (UNSTABLE INITIALIZATION ) 
SECTION 4.1.2. EXP. IV 
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FIG. 4.20 STABILIZED SINGLE STAGE CONTROLLER, APPENDIX C TRAJECTORY 
STARTING AT FC 2, INITIAL PARAMETERS AT AVERAGE VALUE 
(UNSTABLE INITIALIZATION) SECTION 4.2.1, EXPIZ 



< O CD 









Flight condition 1 


Initial gains: 


K 

= 1.5 [k 

i 

W 

+ 

> 

1 

> 

X 

P 

X 

m 

p m p 

K 

= B B 


% 

P ^ 


K 

chosen to 

stabilize (A , B ) 

X 

m 


m p 


1.618 

.0718 -.147 6.88 

D = 

1.456 

-2.40 8.24 -.0749 


Q = 


/lo^ 

0 

0 


0 

0 

0 

0 


Sampling time = 



R = 



Of interest is the capability to eliminate the large steady state error in 
roll rate which results from the poor initial gain selection. (Fig. 1+.22) 
This reduction in steady state error is a result of the significant adapta- 
tion of the feedforward gain matrix (see Fig. i+,23). Adjustments of the 

feedback gain K were noted however ^to only be about 10^. 

Preliminary testing using the augmented controller (eq. 3.^0) 
resulted in a stable but not satisfactory response. It is anticipated that 
this can in the future be remedied by further tuning of the appropriate 
weighting matrices. 

4.2 Nonlinear System Evaluation 

In order to assess the applicability of the linearized or perturba- 
tion adaptive controller to an actual aircraft, tests were made using NASA 
Langley’s batch simulation of the nonlinear six degree-of-freedom equations 
of motion. Initially for purposes of testing the feasibility of just the 
perturbation control algorithms, small magnitude symmetrical square wave 
pilot commands were applied in order to maintain a static flight condition. 
These tests showed that both the optimal linear regulator controller and the 
single stage controller were effective in controlling the incremental states 
of the simulated aircraft. 


74 



DEG/SEC 





Kum(l.l) 


WITH ADAPTATION 






NO ADAPTATION 


Kum(l,2) 


WITH ADAPTATION 


. ^ 


NO ADAPTATION 


TIME (SEC) 

FIG.4.23 IMPLICIT ADAPTATION FEED FORWARD GAIN ADJUSTMENTS 

(SECTION 4.1.3) 




Consequently further experiments were made in order to evaluate the 
overall adaptive system Including the identifier and trim update filters. 
Procedures considered for trim computation included: 

. Holding all trim values constant. This is valid however 
only for small perturbations about a given flight condition. 

Computing through the use of washout filters the trim values 
for CL 9 0, 6 9 6m and assuming zero trim values for p, r, 

3, 4), q, 6^, 6^? 

. Computing through the use of washout filters, the trim values 
for all states and controls. 

These washout filters for the states were defined by the low pass 
filter equation: 



where : 

x.^ = trim state 

1 

a 

X. = total state 
1 

The filter time constants T. were set equal to three times the largest time 
constant t for the corresponding model states as tabulated below. 



T (sec) 
m 

(= 3 max 

q. 

• 91 

2.T3 

V 

10.00 

30.00 

a 

• 91 

2.73 

0 

• 91 

2.73 

P 

l.ltO 

4.20 

r 

l.lto 

4.20 

e 

1.40 

4.20 

<(> 

1.40 

4.20 


With respect to forming trim values for the control signals , 
various possibilities must be considered in view of the presence of both the 
pilot command and the actual applied control u . These include: 
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. Computing a trim value for u using a washout filter, 
and letting u^ denote the actual incremental command, 

. Forming incremental values of u as above and fomiing 
incremental values of u by subtracting out from the 
absolute stick motion the trim values for u • These in 
turn can be formed by either washing out u"^ or by using 
the trim values of u • It should be noted that this pro- 
cedure applied to ste^ changes in u will result in an 
incremental command that varies from the initial step 
change toward zero in accordance with the time constant of 
the washout filters. This is reasonable if after a 
sufficiently long time, the new stick position is to be 
regarded as a new trim position. 

In all cases it is recommended that either periodically or upon 
detection of a step change in stick position that the model incremental state 
vector be reset equal to the aircraft's incremental state vector. This is in 
keeping with the model following philosophy. 

To thus evaluate the applicability of the linearized digital adap- 
tive controller, the optimal adaptive regulator logic was incorporated into 
Langley's nonlinear simulation and tested according to the following outline. 

Objective : 

To evaluate the response of the overall adaptive system with and 
without washout filters and to assess the effectiveness of the linearized 
adaptive control algorithms. 

Procedure : 

The time constants for the filters on the contrpls were selected as 

follows : 


Control 

T. 

1 




6 

e 

2.73 

same 

as 

1 


30.00 

same 

as 

V 

6 

1.4-0 

same 

as 

p 

a 





6 

r 

1.40 

same 

as 

p 


The states and trim were initialized to values corresponding to an altitude of 
6l0m (2000 ft.) and a Mach niimber equal to 0.3. The parameters to be identi- 
fied were initialized at 50^ of their true values while all other parameters 
were held constant at their true initial values. 
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Design Factors ; 

Pilot commands: 

Aileron deflection 

or elevator deflection of 
Control sample time = 0 
Identification time = 0 


+ .01 r, 0 t ^ 5 sec 

o' r, 5 sec £. t ^ 10 sec 
- .01 r, 10 sec < t ^ 15 sec 
0 r, 15 sec < t ^ 20 sec 

1.3^ step 
1 sec 
1 sec 


Gain update time = 1.0 sec 

The following four cases were tested: 

(1) Constant Trim 3 No Adaptation 

(2) Constant Trim, Fully Adaptive 

(3) Washout trim correction of all aircraft states 

and controls, pilot command u corrected for trim 
variation. 

(k) Washout trim correction of v, a, 6, 6 , 6 . 

No change of pilot command u e r 

m 

Results and Discussion : 

Figures U.2i+a, b, c, d depict the behavior of 6 , 6 , p, and 6 
in response to the aileron command for the non-adaptive online regulator 
logic (case l). The significant improvement resulting from adaptation with 
a constant trim value is evident in Figures 4.25a, b, c, d (i.e. case 2). 

Of importance is the capability of the adaptive controller for removing the 
transient oscillation in roll rate and for significantly reducing the magni- 
tude of the sideslip angle. It should be noted that the excessive initial 
oscillations exhibited under adaptive control can be attributed to the 
transient response of the identifier. These, however, did dissipate within 
three seconds. 

It was further observed that correcting u for changes in trim 
computed by washing out either u or u (case 3) resulted in a tendency 
for the model to be too sluggishT^ Thus i? was decided in further tests to 
let u denote the incremental pilot command without any trim correction. 
This is realistic assuming that incremental stick motion can be sensed by the 
fly-by-wire logic. Case 4 results for an elevator step command to the modi- 
fied single stage adaptive logic are shown in Figures 4.26a, b, c. 
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As a guide towards detennining the timing specifications for the 
various adaptive control functions, the CDC- 66 OO nonlinear simulation operat- 
ing in hatch mode required the following time slices: 

. Recursive identification of I 6 parameters 64 ms 

. Adaptation of the optimal regulator gains for 
hoth lateral and longitudinal motion 102 ms 
(using eg. 3.1l) 

. Computation of 6^, 6^, 6^, and 6^ 28 ms 

Since it is not necessary to perform adaptation every sample 
period, these results indicate that the proposed digital adaptive controller 
can he operated without problems at least 10 times per second. 

More prudent programming procedures and the use of machine language 
coding might in fact double or triple this allowable frequency. 

5 . CONCLUSIONS AND RECOMMENDATIONS 

Based upon both the analytical and simulation efforts described in 
the previous chapters, the following reconunendations relative to implementa- 
tion can be made: 

. The two explicit adaptive controllers designed using 

stabilized single stage logic and optimal regulator logic 
are feasible for on-board application. This conclusion 
is based upon analysis and simulation efforts using both 
the linear and nonlinear equations of motion. 

Online estimation of the states and parameters is best 
performed by a procedure which first utilizes the noisy 
measurements directly for parameter estimation, and then 
utilizes these parameter estimates with the state measure- 
ments for state estimation. 

The explicit adaptive controllers are capable of rapid 
recovery from highly erroneous parameter estimates which 
could in fact define a set of destabilizing gains. This 
follows because the relatively large oscillations in the 
aircraft states will result in the identifier's being 
forced by large signal to noise signals with a large 
degree of fluctuation. Thus, rapid convergence towards 
the proper parameter values will take place. 

. On-board implementation of the proposed linearized designs 
is achievable if washout filters are used for computation 
of trim states and controls. 
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. Implicit adaptive control logic shoiild not as yet be 
implemented. Although the resulting system will be 
stable, no procedure has been found for tuning all the 
pertinent weighting factors so as to yield favorable 
response characteristics. 

Recommendations for future efforts include the following: 

. Determine procedures for designing implicit adaptive 
controllers in accordance with desired system behavior , 
specifications. Such procedures will, by eliminating the 
need for an online identifier, reduce the complexity of 
the adaptive system and further ease implementation. 

. Program the two explicit adaptive control algorithms into 
the actual flight computer and interface it with NASA 
Langley’s simulation of the nonlinear equations of motion. 
This will enable a more effective evaluation of the storage, 
timing, and interface requirements of the controllers. 

. Determine the effects of directly incorporating the bending 
modes into the state equations rather than into the sensor 
noise characteristics. Recall from Section 2.1.3 that the 
correlated measurement noise sequences were selected so as 
to reflect both sensor noise and bending effects. Modelling 
the bending modes with additional state equations will 
permit the use of wider band noise sequences with smaller 
variances. 
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Appendix A 


A.l Aircraft Continuous Lateral Matrices 
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A. 2 Aircraft Continuous Longitudinal Matrices 
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Flight Trajectory Used For Evaluation 
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NASA- Langley, 1976 CR-2684 
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